Better Together: Joint Reasoning for Non-rigid 3D Reconstruction with Specularities and Shading
نویسندگان
چکیده
In this paper, we demonstrate the use of shape-from-shading (SfS) to improve both the quality and the robustness of 3D reconstruction of dynamic objects captured by a single camera. Unlike previous approaches that made use of SfS as a post-processing step, we offer a principled integrated approach that solves dynamic object tracking and reconstruction and SfS as a single unified cost function. Moving beyond Lambertian SfS, we propose a general approach that models both specularities and shading while simultaneously tracking and reconstructing general dynamic objects. Solving these problems jointly prevents the kinds of tracking failures which can not be recovered from by pipeline approaches. We show state-of-the-art results both qualitatively and quantitatively.
منابع مشابه
Template-Based Conformal Shape-from-Motion-and-Shading for Laparoscopy
Shape-from-Shading (SfS) is one of the fundamental techniques to recover depth from a single view. Such a method has shown encouraging but limited results in laparoscopic surgery due to the complex reflectance properties of the organ tissues. On the other hand, Template-Based Deformable-Shape-from-Motion (DSfM) has been recently used to recover a coarse 3D shape in laparoscopy. We propose to co...
متن کاملHDM-Net: Monocular Non-Rigid 3D Reconstruction with Learned Deformation Model
Monocular dense 3D reconstruction of deformable objects is a hard ill-posed problem in computer vision. Current techniques either require dense correspondences and rely on motion and deformation cues, or assume a highly accurate reconstruction (referred to as a template) of at least a single frame given in advance and operate in the manner of non-rigid tracking. Accurate computation of dense po...
متن کاملAnalysis of the Geometry of the Distal Femur and Proximal Tibia in the Osteoarthritic Knee: A 3D Reconstruction CT Scan Based Study of 449 Cases
Background: The aim of this study is to evaluate the geometry of the distal femur and the proximal tibia in the osteoarthritic knee using 3D reconstructive CT scan imaging. Methods: 449 patients with knee osteoarthritis were treated surgically in our center with patient-specific technology total knee arthroplasty. Preoperatively, all the patients underwent a CT scan according to a standard ...
متن کاملThree-dimensional object shape from shading and contour disparities.
Both non-Lambertian shading, specularities in particular, and occluding contours have ill-matched binocular disparities. For example, the disparities of specularities depend not only on a surface's position but also on its curvature. Shading and contour disparities do in general not specify a point on the surface. I investigated how shading and contours contribute to perceived shape in stereosc...
متن کاملFunctional Outcome Following Arthroscopic ACL Reconstruction with Rigid Fix: A Retrospective Observational Study
Background: No uniform consensus exists to decide type of fixation for arthroscopic anterior cruciate ligament reconstruction. Hypothsis: There is similar functional outcome after rigid fix compared to other methods of fixation which has been published. Study design: Retrospective observational study. Methods: A total of 50 patients underwent arthroscopic anterior cruciate ligament reconstruc...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1708.01654 شماره
صفحات -
تاریخ انتشار 2016